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Abstract 

We introduce a new formalism and a number of new results in the context of 
geometric computational vision. The classical scope of the research in geometric 
computer vision is essentially limited to static configurations of points and lines 
in P 3 . By using some well known material from algebraic geometry, we open 
new branches to computational vision. 

We introduce algebraic curves embedded in P 3 as the building blocks from 
which the tensor of a couple of cameras (projections) can be computed. In the 
process we address dimensional issues and as a result establish the minimal 
number of algebraic curves required for the tensor variety to be discrete as a 
function of their degree and genus. 

We then establish new results on the reconstruction of an algebraic curves in 
P 3 from multiple projections on projective planes embedded in P 3 . We address 
three different presentations of the curve: (i) definition by a set of equations, 
for which we show that for a generic configuration, two projections of a curve 
of degree d defines a curve in P 3 with two irreducible components, one of degree 
d and the other of degree d{d — 1), (ii) the dual presentation in the dual space 
P 3 *, for which we derive a lower bound for the number of projections necessary 
for linear reconstruction as a function of the degree and the genus, and (Hi) the 
presentation as an hypersurface ofV 5 , defined by the set of lines in P 3 meeting 
the curve, for which we also derive lower bounds for the number of projections 
necessary for linear reconstruction as a function of the degree (of the curve). 

Moreover we show that the latter representation yields a new and efficient 
algorithm for dealing with mixed configurations of static and moving points in 
P 3 . 
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1 Introduction 



Computational vision is the art of inferring three-dimensional properties of an 
object given several views of it. A view is concretely an image taken by a 
camera. From a mathematical point of view, a camera is a device that performs 
a projection from P 3 to P 2 , through a center of projection. What are objects 
that we can deal with in this context? Until recently, for simplicity reasons, 
the objects that were considered in computer vision were essentially composed 
by static points and lines in P 3 . In the last two decades, intensive research has 
been carried out in this context, analyzing the 3D structure of the scene when 
given multiple views. A summary of the past decade of work in this area can 
be found in |) and references to earlier work in || . 

The theory of multiple-view geometry and 3D reconstruction is somewhat 
fragmented when it comes to curve features, especially non-planar algebraic 
curves of any degree and genus. In [jl5[ [l^, [l3| one shows how to recover the 
3D position of a conic section from two and three views, and |16 shows how to 
recover the homography induced by a conic between two views of it, and §, 
show how to recover a quadric surface from projections of its occluding conies. 

In all the above, the projection matrices are given but hardly any thing 
was done when this data is not available. [|[ [hJ show how to recover the 
fundamental matrix from matching conies with the result that 4 matching conies 
are minimally sufficient for a finite numbers of solutions. JTo[ ] generalizes this 
result to higher order curves, but consider only planar curves. 

In this paper we present a general theory for dealing with algebraic curves 
in computational vision, and more precisely in the multiple-view geometry and 
3D reconstruction problem. Thus we investigate three of the fundamental ques- 
tions of computer vision, using algebraic curves: (i) recovering camera geometry 
(fundamental matrix) from two views of the same algebraic curve, (ii) recon- 
struction of the curve from its projection across two or more views, and (iii) 
application of algebraic curves to the structure recovery of dynamic scenes from 
streams of projections (video sequences). 

We start by giving a short presentation of the computer vision background 
related to our work. Then we show how one can recover the so-called projective 
stratum of the camera geometry (epipolar geometry) from two views of a (non- 
planar) algebraic curve. For that purpose we define and derive the generalized 
Kruppa 's equations which are responsible for describing the epipolar constraint 
of two projections of the same algebraic curve. As part of the derivation of those 
constraints we address the issue of dimension analysis and as a result establish 
the minimal number of algebraic curves required for the epipolar geometry to 
be defined up to a finite- fold ambiguity as a function of their degree and genus. 

On the reconstruction front, the curve admits three different representations: 
(i) as the solution of a set of equations in P 3 , for which we show that in a generic 
configuration, the reconstruction from two views of a curve of degree d has two 
irreducible components, one of degree d and the other of degree d(d — 1), (ii) as 
an hypersurface in the dual space P 3 * , for which we derive a lower bound of the 
minimal number of projections necessary for linear reconstruction as a function 
of the curve degree and genus, and (iii) as an hypersurface in P 5 , defined by 
the set of lines in P 3 meeting the curve, for which we also derive lower bounds 
for the number of projections necessary for linear reconstruction as a function 
of curve degree alone. Moreover we show that the latter representation yields a 
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new and efficient algorithm for dealing with mixed configurations of static and 
moving points in P 3 . 



2 Foundation of linear computer vision 

Projective algebraic geometry provides a natural framework to geometric com- 
puter vision. However one has to keep in mind that the geometric entities to 
be considered are in fact embedded into the physical three-dimension euclidian 
space. For this content, the euclidian space is provided with three structures 
defined by three groups of transformations: the orthogonal group PO3 (which 
defines the euclidian structure and which is included into the affinc group), 
PA3 (defining the affine structure and itself included into the projective group), 
PG3 (defining the projective structure). We fix [X, Y, Z, T] T , as homogeneous 
coordinates, and T — as the plane at infinity. 



2.1 A single camera system 



Computational vision starts with images captured by cameras. The camera 
components are the following: 

• a plane 1Z, called the retinal plane, or image plane, 

• a point O, called either the optical center or the camera center, and which 
does not lie on the plane 1Z. 

The plane 1Z is regarded as a two dimension projective space embedded into 
P 3 . Hence it is also denoted by i(P 2 ). The camera is a projection machine: 
7T : P 3 \ {O} -» i{¥ 2 ), P 1 ► OP n i(P 2 ). The projection tt is determined (up to 
a scalar) by a 3 x 4 matrix M (the image of P being AMP). 

The physical properties of a camera imply that M can be decomposed as 
follows: 

/ s u 
M= af v Q [R;t], 
1 

where (/, a, s, Uo, Vo) are the so-called internal parameters of the camera, whereas 
the rotation R and the translation t are the external parameters. 
It is easy to see that: 

• The camera center O is given by MO = 0. 

• The matrix M T maps a line in i(P 2 ) to the only plane containing both 
the line and O. 

• There exists a matrix M € ^6x3(^)1 which is a polynomial function of 
M, that maps a point p G i(P 2 ) to the line Op (optical ray), represented 
by its Pliicker coordinates in P 5 . If the camera matrix is decomposed as 
follows: 



M 
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then for p = [x, y, z] T , the optical ray L p = Mp is given by the extensor: 
L p = xA A + y8 A r + zr A A, where A denotes the meet operator in 
the Grassman-Cayley algebra (see pj). 

• The matrix M = M T maps lines in P 3 to lines in i(P 2 ). 

Moreover we will need in the sequel to consider the projection of the abso- 
lute conic onto the image plane. The absolute conic is simply defined by the 
following equations: 

f X 2 + Y 2 + Z 2 = 
\ T = 

By definition, the absolute conic is invariant by euclidian transformations. 
Therefore its projection onto the image plane, defined by the matrix u>, is a 
function of the internal parameters only. By Cholesky decomposition uj = LU, 
where L (respectively U) is lower (respectively upper) triangular matrix. Hence 

it is easy to see that U = M , where M is the 3x3 matrix of the internal 
parameters of M. 



2.2 A system of two cameras 

Given two cameras, (Oj, £j(P 2 ))j=i,2 are their components where «i(P 2 ) and 
^(P 2 ) are two generic projective planes embedded into P 3 , and Oi and O2 
are two generic points in P 3 not lying on the above planes. As in ^j], let 
7Tj : P 3 \ {Oj} -» ij(P 2 ), P i-» OjP n i,(P 2 ) be the respective projections. The 
camera matrices are Mj, i = 1,2. 



2.2.1 Homography between two images of the same plane 



Consider the case where the two cameras are looking at the same plane in space, 
denoted by A. Let 

rT 



Mi 



be the camera matrices, decomposed as above. Let P be a point lying on A. We 
shall denote the projections of P by p^ = [xj, Zi] T = M^P, where = means 
equality modulo multiplication by a non-zero scalar. 

The optical ray generated by pi is given by L P1 = x\Ai A61+ yi@i A Ti + 
ziriAAx. Hence P = L P1 AA = xiA a A 81 A A + yi9i ATi A A + z^i A Ai A A. 
Hence P2 = M2P is given by the following expression: P2 = HaPi where: 



H 



A 



r^(Ai A 81 A A) 
A£(Ai A 61 A A) 
62 (Ai A 81 A A) 



r^(0i ATiAA) 
A^(0i ATi A A) 
8^(81 A Ti A A) 



r^Tx AAi A A) 
Af(Ti A A x A A) 
6^(ri A Ai A A) 



This yield the expression of the collineation Ha between two images of the same 
plane. 



Definition 1 The previous collineation is called the homography between the 
two images, through the plane A. 
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2.2.2 Epipolar geometry 

Definition 2 Let (Oj, ij(P 2 ), ~M.j)j=i,2 being defined as before. Given a pair 
(P11P2) € ^(P 1 ) x « 2 (P 2 ), we say that it is a pair of corresponding or matching 
points if there exists P € P 3 such that pj = 7Tj(P) for j = 1,2. 

Consider a point p e ii(P 2 ). Then p can be the image of any point lying 
on the fiber tt^ (p). Then the matching point in the second image must lie 
on 7T2(7r 1 " 1 (p)), which is, for a generic point p, a line on the second image. 
Since ~k\ and 7r 2 are both linear, there exists a matrix F £ .M3 X 3(K), such that: 
£(p) = 7r 2 (7rf 1 (p)) is given by Fp for all but one point in the first image. 

Definition 3 The matrix F is called the fundamental matrix, where as the line 
l p = Fp is called the epipolar line of p. 



Let ei = Oi0 2 n «i(P 2 ) and e 2 = n i 2 (P )• Those two points are 

respectively called the first and the second epipole. It is easy to see that Fe! = 0, 
since 7rj" 1 (ei) = O1O2 and 7r 2 (Oi0 2 ) = e 2 . Observe that by symmetry F T is 
the fundamental matrix of the reverse couple of images. Hence F T e 2 = 0. Since 
the only point in the first image that is mapped to zero by F is the first epipole, 
F has rank 2. 

Now we want to deduce an expression of F as a function of the camera 
matrices. By the previous analysis, it is clear that: F = M 2 Mi. Moreover we 
have the followings properties: 

Proposition 1 For any plane A, not passing through the camera centers, the 
following equalities hold: 

1. 

F = [e 2 ] x Ha, 

where [e 2 ] x is the matrix associated with the cross-product as follows: for 
any vector p, e 2 x p = [e 2 ] x p. Hence we have: 



Nx = 



-e 23 e 22 
e 23 -e 2l 
-e 22 e 2l 



In particular, we have: F = [e 2 ] x H oc , where H m is the homography 
between the two images through the plane at infinity. 

2. 

hXf + f t h a = o. (1) 

Proof: The first equality is clear according to its geometric meaning. Given a 
point p in the first image, Fp is its epipolar line in the second image. The optical 
ray L p passing trough p meets the plane A in a point Q, which projection in 
the second image is HaP- Hence the epipolar line must be e 2 VHaP- This gives 
the required equality. The second equality is simply deduced from the first one 
by a short calculation. ■ 
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Proposition 2 For a generic plane A, the following equality holds: 

H A ei = e 2 . 

Proof: The image of the ei by the homography must be the projection on 
the second image of the point defined as being the intersection of the optical 
ray generated by ei and the plane A. Hence: HaCi = M 2 (L ei A A). But 
L ei = Oi0 2 . Thus the result must be M 2 Oi (except when the plane is passing 
through 2 ), that is the second epipole e 2 . ■ 

2.2.3 Canonical stratification of the reconstruction 

Three-dimension reconstruction can be achieved from a system of two cameras, 
once the camera matrices are known. However a typical situation is that the 
camera matrices are unknown. Then we face a double problem: recovering the 
camera matrices and the actual object. There exists an inherent ambiguity. 
Consider a pair of camera matrices (Mi, M 2 ). If you change the world coordi- 
nate system by a transformation V <G PG3, the camera matrices are mapped to 
(MiV -1 , M 2 V~ 1 ). Therefore we define the following equivalence relation: 

Definition 4 Given a group of transformation G, two pairs of camera matrices, 
say (Mi,M 2 ) and (Ni,N 2 ) are said to be equivalent modulo multiplication by 
G if there exists VeG, such that: Mi = NiV and M 2 = N 2 V. 

Any reconstruction algorithm will always yields a reconstruction modulo 
multiplication by a certain group of transformations. More presicely there exist 
three levels of reconstruction according to the information that can be extracted 
from the two images and from a-priori knowledge of the world. 

Projective Stratum 

When the only available information is the fundamental matrix, then the 
reconstruction can be performed modulo multiplication by PG3. Indeed from 
F, the so-called intrinsic homography S = — ]|ff][F is computed and the camera 
matrices are equivalent to: ([I; 0], [S; e 2 ]). 

Affine Stratum 

When, in addition of the epipolar geometry, the homography between the 
two images through the plane at infinity, denoted by H^, can be computed, the 
reconstruction can be done modulo multiplication by the group of affine trans- 
formations. Then the two camera matrices are equivalent to: ([I; 0], [Hoc; e 2 ]). 

Euclidian Stratum 

The euclidian stratum is obtained by the data of the projection of the abso- 
lute conic onto the image planes, which allows recovering the internal param- 
eters of the cameras. Once the internal parameters of the cameras are known 
the relative motion between the cameras expressed by a rotation R and a trans- 
lation t can be extracted from the fundamental matrix. However only the di- 
rection of t but not the norm can be recovered. Then the cameras matrices are 
equivalent, modulo multiplication by the group of similarity transformations, 
to: (Mi [I; 0], M 2 [R; t]), where Mi and M 2 are the matrices of the internal 
parameters. 
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Note that the projection of the absolute conic on the image can be com- 
puted using some a-priori knowledge of the world. Moreover there exist famous 
equations linking u\ and L02 when the epipolar geometry is given. These are the 
so-called Kruppa 's equations, defined in the following proposition. 

Proposition 3 The projections of the absolute conic onto two images are re- 
lated as follows. There exists a scalar X such that: 

[ei£wf[ei] x =AF T wJF, 

where [ejjx is the matrix representing the cross-product by e\ and w* is the 
adjoint matrix of u>i . 

Let ti be the tangents to 7Tj(fi) through e^. Kruppa's equations simply state 
that ei and £2 are projectively isomorphic. 



3 Recovering the epipolar geometry from curve 
correspondences 

Recovering epipolar geometry from curve correspondences requires the estab- 
lishment of an algebraic relation between the two image curves, involving the 
fundamental matrix. Hence such an algebraic relation may be regarded as an 
extension of Kruppa's equations. In their original form (see proposition 
these equations have been introduced to compute the camera-intrinsic param- 
eters from the projection of the absolute conic onto the two image planes fl^j . 
However it is obvious that they still hold if one replaces the absolute conic by 
any conic that lies on a plane that does not meet any of the camera centers. 
In this form they can be used to recover the epipolar geometry from conic cor- 
respondences |], fl0| . Furthermore it is possible to extend them to any planar 
algebraic curve fllPf . Moreover a generalization for arbitrary algebraic spatial 
curves is possible and is a step toward the recovery of epipolar geometry from 
matching curves. 

Therefore we shall prove and generalize Kruppa's equations to arbitrary 
smooth irreducible curve that cannot be embedded in a plane and whose degree 
d > 2 (the case of line is excluded since one cannot deduce constraints on the 
epipolar geometry from a pair of matching lines and the case of planar curve 
has already been treated in ]uH). 

At this stage we recall a number of facts, that will be useful in the sequel, 
concerning the projection of a space curve onto a plane. 

We shall mention that all our theoretical results are true when the ground 
field is the field of complex numbers. Finally we shall consider only the real 
solutions. 



3.1 Single view of a space curve 

Let M be the camera matrix, O the camera center, 1Z the retinal plane (as in 



2.1). Let X be a smooth irreducible embedded in P 3 and which degree d > 2. 
Let Y be the projection of X by the camera. It is well known that: 

1. The curve Y will always contain singularities. Furthermore for a generic 
position of the camera center, the only singularities of Y will be nodes. 
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2. The class of a planar curve is defined to be the degree of its dual curve. 
Let to be the class of Y. Then m is constant for a generic position of the 
camera center. 

3. If d and g are the degree and the genus of X, they are respectively, for 
a generic position of O, the degree and the genus of Y and the Pliickcr 
formula yields: 

m = d(d — 1) — 2(jjnodes), 
9 = - (ttnodes), 

where {(nodes denotes the number of nodes of Y. Hence the genus, the 
degree and the class are related by: 

to = 2d + 2.g - 2. 
3.2 Generalized Kruppa's equations 

We are ready now to investigate the recovery of the epipolar geometry from 
matching curves. Let Mi, i = 1,2, be the camera matrices. Let F and ei be 
the fundamental matrix and the first epipolc, Fei = 0. We will need to consider 

the two following mappings: p hi ei Vp and p i— > Fp. Both are defined on 
the first image plane; 7 associates a point to its epipolar line in the first image, 
while £ sends it to its epipolar line in the second image. 

Let Y\ and Y 2 be the image curves (projections of X onto the image planes). 
Assume that they are defined by the polynomials fx and f 2 . Let Y* and Y 2 
denote the dual image curves, whose polynomials are respectively <f>\ and <j) 2 . 
Roughly speaking, the generalized Kruppa's equations state that the sets of 
epipolar lines tangent to the curve in each image are projectively equivalent. 

Theorem 1 Generalized Kruppa's equations 

For a generic position of the camera centers with respect to the curve in space, 
there exists a non-zero scalar X, such that for all points p in the first image, the 
following equality holds: 

02(£(p))=A0i( 7 (p)) (2) 

Remark: Observe that if X is a conic and Ci and C 2 the matrices that 
respectively represent Y\ and Y 2 , the generalized Kruppa's equations reduce to 
the classical Kruppa's equations, that is: [ei]xC*[ei] x = F T C2F, where C\ 
and C2 are the adjoint matrices of Ci and C2. 

Proof: Let a be the set of epipolar lines tangent to the curve in image i. We 
start by proving the following lemma. 

Lemma 1 The two sets e\ and e 2 are projectively equivalent. Furthermore for 
each corresponding pair of epipolar lines, (1,1') G t\ x e 2 , the multiplicity of I 
and Y as points of the dual curves Y* and Y 2 * are the same. 

Proof: Consider the following three pencils: 

1. er(L) = F 1 , the pencil of planes containing the baseline, generated by the 
camera centers, 

2. er(ei) = P 1 , the pencil of epipolar lines through the first epipole, 
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3. <r(e2) = P 1 , the pencil of epipolar lines through the second epipolc. 

Thus we have C cr(ej). Moreover if E is the set of plane in <x(L) tangent to 
the curve in space, there exist a one-to-one mapping from E to each e^. This 
mapping also leaves the multiplicities unchanged. This completes the lemma. ■ 
This lemma implies that both sides of the equation || define the same alge- 
braic set, that the union of eipolar lines through ei tangent to Y\. Since 0i 



and 02, in the generic case, have same degree (as stated in 3.1), each side of 
equation ^| can be factorized into linear factors, satisfying the following: 

01 (7(af, 2/, z)) = Yli(aux + a 2 iy + a3iz) a * 
<M£(£, 2/, 2)) = l\i \i{aiiX + a2iy + a 3i z) bi , 

where a, = bj — m. By the previous lemma, we must also have dj = 6; 
for i. ■ 

By eliminating the scalar A from the generalized Kruppa's equations (Q) we 
obtain a set of bi-homogeneous equations in F and ei. Hence they define a 
variety in P 2 x P 8 . This gives rise to an important question. How many of 
those equations are algebraically independent, or in other words what is the 
dimension of the set of solutions? This is the issue of the next section. 



3.3 Dimension of the set of solutions 

Let {Ei(F, ei)}j be the set of bi-homogeneous equations on F and ei, extracted 
from the generalized Kruppa's equations (^). Our first concern is to determine 
whether all solutions of equation (Q) are admissible, that is whether they satisfy 
the usual constraint Fei = 0. Indeed we prove the following statement: 

Proposition 4 As long as there are at least 2 distinct lines through ei tangent 
to Y\, equation (Q) implies that rankF = 2 and Fei = 0. 

Proof: The variety defined by <j>i(j(p)) is then a union of at least 2 distinct 
lines through ei. If equation (||) holds, 02 (£(p)) must define the same variety. 

There are 2 cases to exclude: If rankF — 3, then the curve defined by 
02 (^(p)) is projectively equivalent to the curve defined by 2 , which is Y*. In 
particular, it is irreducible. 

If rankF < 2 or rankF — 2 and Fei 7^ 0, then there is some a, not a 
multiple of ei, such that Fa = 0. Then the variety defined by 02(£(p)) is a 
union of lines through a. In neither case can this variety contain two distinct 
lines through ei, so we must have rankF — 2 and Fei =0. ■ 

As a result, in a generic situation every solution of {Ei(F, ei)}j is admissible. 
Let V be the subvariety of P 2 x P 8 x P 2 defined by the equations {-Ei(F, ei)}j 
together with Fei = and e2 T F = T , where e2 is the second epipole. We 
next compute the lower bound on the dimension of V , after which we would be 
ready for the calculation itself. 

Proposition 5 IfVis non-empty, the dimension ofV is at least 7 — m. 

Proof: Choose any line 1 in P 2 and restrict ei to the affine piece P 2 \ 1. Let (x, y) 
be homogeneous coordinates on 1. If Fei = 0, the two sides of equation (Q) are 
both unchanged by replacing p by p + aei . So equation (|2|) will hold for all p 
if it holds for all pel. Therefore equation (0) is equivalent to the equality of 2 
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homogeneous polynomials of degree to in a; and y, which in turn is equivalent 
to the equality of (m + 1) coefficients. After eliminating A, we have to algebraic 
conditions on (ei,F,e2) in addition to Fei = 0, e2 T F = T . 

The space of all epipolar geometries, that is, solutions to Fei = 0, e2 T F = 
T , is irreducible of dimension 7. Therefore, V is at least (7 — TO)-dimensional. 
■ 

For the calculation of the dimension of V we introduce some additional 
notations. Given a triplet (ei,F, e 2 ) e P 2 x P 8 x P 2 , let {qia(ei)} (respectively 
{q2a(e2)}) be the tangency points of the epipolar lines through ei (respectively 
e2) to the first (respectively second) image curve. Let Q Q (ei,e2) be the 3d 
points projected onto {qia(ei)} and {q2a(e2)}. Let L be the baseline joining 
the two camera centers. We next provide a sufficient condition for V to be 
discrete. 

Proposition 6 For a generic position of the camera centers, the variety V will 
be discrete if, for any point (ex,F, e2) S V, the union of L and the points 
Qa(ei,e2) is not contained in any quadric surface. 

Proof: For generic camera positions, there will be to distinct points {qi a (ei)} 
and {q2a( e 2)}j an d we can regard qi Q , q2 Q locally as smooth functions of 
e 2 - 

We let W be the affine variety in C 3 x C 9 x C 3 defined by the same equations 
as V. Let O = (ei, F, e2) be a point of W corresponding to a non-isolated point 
of V. Then there is a tangent vector i9 = (v, v') to W at with $ not a 
multiple of F. 

If X is a function on W, Ve,i9(x) Wln denote the derivative of x m t ne 
direction defined by ■& at O. For 

Xa(ei,F, e 2 ) = q2 Q (e 2 ) T Fqi Q (ei), 

the generalized Kruppa's equations imply that Xq vanishes identically on W , so 
its derivative must also vanish. This yields 

V e ,4x Q ) = (Ve^(q 2Q )) T Fqi Q + qf a $qi Q + qLF(Ve,*(qia)) - 0. (3) 

We shall prove that Ve ) ^(qi Q ) is in the linear span of qi Q and ei. (This 
means that when the epipole moves slightly, qi Q moves along the epipolar line.) 
Consider n(t) = /(qi Q (ei + tv)), where / is the polynomial defining the image 
curve Y\. Since qi Q (ei + tv) € Y\, k = 0, so the derivative k'(0) = 0. On the 
other hand, re'(O) = Ve,i?(/(qia)) = gradq la (/) T Ve,#(qia)- 

Thus we have gradq la (/) T Ve^(qi Q ) = 0. But also gradq la (f) T c[i a = 
and gradq la (f) T ei — 0. Since gradq la (f) ^ O (qi Q is not a singular point of 
the curve), this shows that Ve,^(qi a ), qi a , and ei are linearly dependent. <\\ a 
and ei are linearly independent, so Ve,tf(qia) must be in their linear span. 

We have that q^Fei = q^Fq^ = 0, so q^FVe^qia) = 0: the third 
term of equation (||) vanishes. In a similar way, the first term of equation (||) 
vanishes, leaving 

qL^qia = o. 

The derivative of x( e ijF, e2) = Fei must also vanish, which yields: 

e 2 T "I>ei = 0. 
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From the first equality, we deduce that for every Qq,, we have: 

Q^M^$ Ml Q Q = 0. 

From the second equality, we deduce that every point P lying on the baseline 
must satisfy: 

P T Mf$MiP = 0. 

The fact that $ is not a multiple of F implies that M^$Mi ^ 0, so together 
these two last equations mean that the union LU{Q a } lies on a quadric surface. 
Thus if there is no such quadric surface, every point in V must be isolated. ■ 
Observe that this result is consistent with the previous proposition, since 
there always exist a quadric surface containing a given line and six given points. 
However in general there is no quadric containing a given line and seven given 
points. Therefore we can conclude with the following theorem. 

Theorem 2 For a generic position of the camera centers, the generalized Kruppa 's 
equations define the epipolar geometry up to a finite-fold ambiguity if and only 
ifm>7. 

Since different curves in generic position give rise to independent equations, 
this result means that the sum of the classes of the image curves must be at 
least 7 for V to be a finite set. 

4 3D Reconstruction 

We turn our attention to the problem of reconstructing an algebraic curve 
from two or more views, given known camera matrices (epipolar geometries are 
known) . The basic idea is to intersect together the cones defined by the camera 
centers and the image curves. However this intersection can be computed in 
three different spaces, giving rise to different algorithms and applications. 

We shall mention that in |J a scheme is proposed to reconstruct an algebraic 
curve from a single view by blowing-up the projection. This approach results in 
a spatial curve defined up to an unknown projective transformation. In fact the 
only computation this reconstruction allows is the recovery of the properties 
of the curve that are invariant to projective transformation. Moreover this 
reconstruction is valid for irreducible curves only. However reconstructing from 
two projections not only gives the projective properties of the curve, but also the 
relative depth of it with respect to others objects in the scene and furthermore 
the relative position between irreducible components. 

4.1 Reconstruction P 3 

Let the camera projection matrices be Mi and M2. Hence the two cones defined 
by the image curves and the camera centers are given by: Ai(P) = /i(MiP) 
and A2(P) = /^(M^P). The reconstruction is defined as the curve whose 
equations are Ai = and A2 = 0. This curves has two irreducible components 
as the following theorem states. 

Theorem 3 For a generic position of the camera centers, that is when no epipo- 
lar plane is tangent twice to the curve X , the curve defined by {Ai = 0, A2 = 0} 
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has two irreducible components. One has degree d and is the actual solution of 
the reconstruction. The other one has degree d(d — 1). 

Proof: For a line 1 C P 3 , we write tr(l) for the pencil of planes containing 1. 
For a point p G P 2 , we write cr(p) for the pencil of lines through p. There is a 
natural isomorphism between a(ei), the epipolar lines in image i, and c(L), the 
planes containing both camera centers. Consider the following covers of P 1 : 

1. X — cr(L) = P 1 , taking a point x G X to the epipolar plane that it 
defines with the camera centers. 

2. Yi er(ei) = er(L) = P 1 , taking a point y G Yi to its epipolar line in 
the first image. 

3. Yi o-(e 2 ) — o^L) = P 1 , taking a point y E Y 2 to its epipolar line in 
the second image. 

If pi is the projection X — ► Yi, then 77 = r/ipi. Let B the union set of branch 
points of 771 and 772- It is clear that the branch points of 77 are included in B. Let 
S = P 1 \ B, pick t G 5", and write X s = J? -1 ^), x t = ^{t). Let p Xs be the 
monodromy: ir\{S, t) — > Perm(X t ), where Perm(Z) is the group of permuta- 
tion of a finite set Z. It is well known that the path-connected components of X 
are in one-to-one correspondence with the orbits of the action of im(fix s ) on Xt- 
Since X is assumed to be irreducible, it has only one component and im(px s ) 
acts transitively on X t . Then if im(px s ) is generated by transpositions, this 
will imply that im(px s ) = Perm(X t ). In order to show that im(px s ) 1S actu- 
ally generated by transpositions, consider a loop in P 1 centered at t, say l t . If h 
does not go round any branch point, then l t is homotopic to the constant path 
in S and then p,x s ([h}) — 1- Now in B, there are three types of branch points: 

1. branch points that come from nodes of Y\: these are not branch points of 
V, 

2. branch points that come from nodes of Yi: these are not branch points of 
V, 

3. branch points that come from epipolar lines tangent either to Y\ or to Y 2 : 
these are genuine branch points of rj. 

If the loop l t goes round a point of the first two types, then it is still true 
that p,x s (['*]) — 1- Now suppose that l t goes round a genuine branch point of 77, 
say b (and goes round no other points in B). By genericity, b is a simple two- fold 
branch point, hence px s ([h]) is a transposition. This shows that im(px s ) is 
actually generated by transpositions and so im(p,x s ) = Perm(X t ). 

Now consider X, the curve defined by {Ai = 0, A 2 = 0}. By Bezout's 
Theorem X has degree d 2 . Let x G X. It is projected onto a point in Yi, such 
that 771 (j/i) = 772(2/2)- Hence X = Y\ x P i Y 2 ; restricting to the inverse image of 
the set S, we have X$ = Xs X5X5. We can therefore identify X t with X t xX t . 
The monodromy p Xs can then be given by p Xs (x,y) = (px s f-Xs iu))- Since 
im(pxs) — Perm(Xt), the action of im{p, Xs ) on X t xX t has two orbits, namely 
{(x,x)} = X t and {(a;, y)|x 7^ y}. Hence X has two irreducible components. 
One has degree d and is X, the other has degree d 2 — d = d(d — 1). ■ 
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This result provides an algorithm to find the right solution for the recon- 
struction in a generic configuration, except in the case of conies, where the two 
components of the reconstruction are both admissible. 

4.2 Reconstruction in the Dual Space 

Let X* be the dual variety of X. Since X is supposed not to be a line, the 
dual variety X* must be a hypersurface of the dual space [Q. Hence let T 
be a minimal degree polynomial that represents X* . Our first concern is to 
determine the degree of T. 

Proposition 7 The degree of T is m, that is, the common degree of the dual 
image curves. 

Proof: Since X* is a hypersurface of P 3 *, its degree is the number of points 
where a generic line in P 3 * meets X* . By duality it is the number of planes in 
a generic pencil that are tangent to X. Hence it is the degree of the dual image 
curve. Another way to express the same fact is the observation that the dual 
image curve is the intersection of X* with a generic plane in P 3 *. Note that this 
provides a simple proof that the degree of the dual image curve is constant for 
a generic position of the camera center. ■ 
For the reconstruction of X* from multiple views, we will need to consider 
the mapping from a line 1 of the image plane to the plane that it defines with 
the camera center. Let [i : 1 1— > M T 1 denote this mapping. There exists a link 
involving T, /i and tf>, the polynomial of the dual image curve: T(/i(l)) = 
whenever </>(l) = 0. Since these two polynomials have the same degree (because 
fj, is linear) and <f> is irreducible, there exist a scalar A such that 

T( M (1)) = A0(1), 

for all lines 1 G P 2 *. Eliminating A, we get ( m I ^ 2 ) — 1 linear equations on T. 
Since the number of coefficients in T is ( m T ^ 3 ) , we can state the following result: 

Proposition 8 The reconstruction in the dual space can be done linearly using 
at least k > m2 + 6T "+ n views. 

— 3(m+3) 

From a practical point of view, it is worth noting that the fitting of the dual 
image curve is not necessary. It is sufficient to extract tangents to the image 
curves at distinct points. Each tangent 1 contributes to one linear equation on 
T: T(/i(l)) = 0. However one cannot obtain more than ( m ^ 2 ) — 1 linearly inde- 
pendent equations per view. 



4.3 Reconstruction in £7(1, 3) 

Let 5(1,3) be the Grassmanian of lines of P 3 . Consider the set of lines in P 3 
meeting the curve X of degree d. This defines an irreducible subvariety of Q{\, 3) 
which is the intersection of Q(l, 3) with an irreducible hypersurface of degree d 
in P 5 (see [Q), given by a homogeneous polynomial T, defined modulo the dth 
graded piece 1(0(1, 3))^ of the ideal of 5(1,3) and modulo scalars. However 
picking one representative of this equivalence class is sufficient to reconstruct 
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entirely without any ambiguity the curve X. Hence we need to compute the 
class of r in the homogeneous coordinate ring of 5(1,3), or more precisely in 
its dth graded piece, S(Q (1,3)) 4, which dimension is ( d + 5 ) - {^l? 5 )- 

Let / be the polynomial defining the image curve, Y . Consider the mapping 
that associates to an image point its optical ray: v : p Mp. Hence the 
polynomial T(v(p)) vanishes whenever /(p) does. Since they have same degree 
and / is irreducible, there exists a scalar A such as for every point p G P 2 , we 
have: 

I>(p)) = A/( P ). 

This yields ( d ^ 2 ) — 1 linear equations on T. 

Hence a similar statement to that in Proposition || can be made: 

Proposition 9 The reconstruction in Q(l, 3) can be done linearly using at least 
k > l d3+sd2 d +f d+2S views. 

As in the case of reconstruction in the dual space, it is not necessary to 
explicitly compute /. It is enough to pick points on the image curve. Each 
point yields a linear equation on T: T(v(p)) = 0. However for each view, one 
cannot extract more than ^d 2 + Id independant linear equations. 

5 Applications to dynamic configurations of points 

In this section we show that the reconstructions in Q(l,3) can be applied to 
trajectory recovery. Consider a point moving along a smooth trajectory. The 
motion is assumed to be well approximated by a low degree irreducible algebraic 
curve. This requirement is in fact very natural and has a widely broad validity 
in practice. Now we proceed to show how trajectory recovery can be achieved. 

A set of cameras Mj, i = 1, m which are either static or moving is viewing 
at a set of points Pj,j = l,...,n either static or moving. The cameras are 
independant and in particular they are not supposed to be synchronized. Let 
Pijk be the projection of the point Pj onto the camera i at time k. 

For a given point Pj, for all i and k, the optical rays, Lyj. = M,-pyfc meet the 
trajectory of Pj. Then according to the geometric entity those rays generate, 
the motion of Pj can be recovered. Here we provide a table that gives the 
correspondence between this entity and the motion of P j . 



Motion of Pj 


Geometry entity generated 
by {Lyfc} in P 5 


Static point 


Plane included 
in 5(1,3) 


Point moving on a line 


Intersection of Q(l, 3) 
with an hyperplane 


Point moving on a conic 


Intersection of £7(1, 3) 
with a quadric 






Point moving on a curve 
of degree d 


Intersection of £7(1, 3) 
with an hypersurface of degree d 
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